Estimation of the vocal tract spectrum from articulatory movements using phoneme-dependent neural networks
نویسندگان
چکیده
This paper presents an estimation method of the vocal tract spectrum from articulatory movements. The method is based on the interpolation of spectra obtained by phonemedependent neural networks. Given the phonemic context and articulation timing corresponding to each phoneme, the proposed method first transforms articulator positions to phoneme-dependent spectra. Then the vocal tract spectrum is estimated by the interpolation of transformed spectra. This interpolation is based on the distance among the input articulator position and that of the preceding and succeeding phonemes. Also, a training procedure of the neural networks is presented while taking the spectral interpolation into account. Articulatory and acoustic data pairs collected by a simultaneous recording of articulator positions and speech were used as the training and test data. Finally, we showed an estimation result using the proposed method.
منابع مشابه
Determination of the vocal tract spectrum from the articulatory movements based on the search of an articulatory-acoustic database
This paper presents a method for determining the vocaltract spectrum from the positions of xed points on the articulatory organs. The method is based on the search of a database comprised of pairs of articulatory and acoustic data representing the direct relationship between the articulator position and vocal-tract spectrum. To compile the database, the electro-magnetic articulograph (EMA) syst...
متن کاملEvaluation of speech inversion using an articulatory classifier
This paper presents an evaluation method for statistically based speech inversion, in which the estimated vocal tract shapes are classified into phoneme categories based on the articulatory correspondence with prototype vocal tract shapes. The prototypes are created using the original articulatory data and the classifier hence permits to interpret the results of the inversion in terms of, e.g.,...
متن کاملMapping from articulatory movements to vocal tract spectrum with Gaussian mixture model for articulatory speech synthesis
This paper describes a method for determining the vocal tract spectrum from articulatory movements using a Gaussian Mixture Model (GMM) to synthesize speech with articulatory information. The GMM on joint probability density of articulatory parameters and acoustic spectral parameters is trained using a parallel acousticarticulatory speech database. We evaluate the performance of the GMM-based m...
متن کاملA Neural Network Model Of Speech Acquisition And Motor Equivalent Speech Production Running title: Speech acquisition and motor equivalence
This article describes a neural network model that addresses the acquisition of speaking skills by infants and subsequent motor equivalent production of speech sounds. The model learns two mappings during a babbling phase. A phonetic-to-orosensory mapping specifies a vocal tract target for each speech sound; these targets take the form of convex regions in orosensory coordinates defining the sh...
متن کاملOn the Use of a Wave-Reflection Model for the Estimation of Spectral Effects due to Vocal Tract Length Changes with Application to Automatic Speech Recognition
Vocal tract length normalization (VTLN) is commonly used in state-of-the-art automatic speech recognition (ASR) systems to reduce the mismatch between speaker-dependent formant frequency scalings. Usually, the normalization is done by a piece-wise linear scaling of the filter bank center frequencies. The linear scaling is motivated by a uniform acoustic tube model that does not take any loss ef...
متن کامل